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ABSTRACT 



A method is described for the introduction into the Fortran 63 
language of a special operator for differentiation which would be 
executed when encountered during compilation. The original 
expression would be extracted from the Fortran equation and 
replaced by its symbolic derivative; the translation process would 
then proceed in the normal manner. 

A model algebraic translator, written in Fortran 63, is 
described and test results are presented. 
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I. INTRODUCTION 

Hanson* and others before him recognized the need for a 
compiler routine which would accept an algebraic expression and 
print-out a symbolic representation of the derivative of that 
expression in addition to generating the necessary machine 
symbolic macros required for subsequent numerical evaluation by 
the computer. This thesis presents a method to accomplish those 
goals in the Fortran 63 language. [ 3 ] 

% 

The method described herein assumes the utilization of 
reverse Polish notation^ and a left to right scan during the 
compilation process. 

"DX" is defined as a special operator, signifying 
differentiation. This operator is somewhat analogous in design 
and use to the normal Fortran "Function", e.g. , SINF, which 
appears to be treated both as an operator and an operand during 
its life cycle. Certainly, SINF signifies and init|ates an 
operation. Yet, during the translation process, the function is 
treated as an operand and is paired with a special operator, 

*Hanson, J. W. , J. S. Caviness and C. Joseph. "Analytic 
Differentiation by Computer", Communications , ACM . Vol. 5, 

No. 6, June 1962: 349. 

9 

Hamblin, C. L. , "Translation to and from Polish notation", 
Computer Toumal 5 , 3, October 1962: 210-213. 
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usually the period symbol. This similarity in the utilization of the 
"DX" will be evident. However, since there will also be 
dissimilarities, the authors have chosen to refer to the 
differentiation operator, DX, as a "dual-operator" for clarity of 
exposition. 

The routine for translation from Fortran notation to reverse 
Polish notation requires the recognition of the dual~operator, DX, 
and a special subroutine for translation of the dual-operator and 
its operand. For the purpose of describing this procedure, a 
simplified routine for translation to reverse Polish is presented. 

The next operation of translation of reverse Polish notation 
into machine symbolic language, likewise, requires recognition 
of the dual~operator, DX, and a special subroutine for execution 
of the derivative operator. This subroutine is designed to 
extract the derivative operator and its operand from the Polish 
string, execute the differentiation, place the symbolic result 
into the Polish string, and return control to the primary routine 
at the original point of entry. 

II. HISTORICAL BACKGROUND 

O 

Hanson presented a program which would accomplish the 
analytic differentiation of a mathematical expression on a digital 

“^Hanson, J. W. , et al. , op. cit . *,' 349-355 . 
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computer. He first described the methods and accomplishments 
which had taken place in this field prior to the writing of his 
paper. His approach was to take an input mathematical expression 
and covert it into triples . He then took the differentiated 
expression of each of these triples incorporating the Ershov 
algorithm 4 in the differentiation. 

In February 1964, R. E. Wengert^ wrote a paper which 
developed a program to give a numerical evaluation of a 
derivative without developing the analytic expression. His 
method was to set up a library of elementary function subroutines. 
This would work only for the simple routines , and would involve 
the programmer in using the CALL statements in his program to 
arrive at the solution to his problem. Wilkens u and Bellman also 
propose the use of library subroutines to determine the value of 
a derivative. 

4 Ibid . 

^Wenger, R. E. , "A Simple Automatic Derivative Evaluation 
Program", Communications , ACM . Vol. 7, No. 8, August 1964: 
463-464. 

Wilkins, R. D. , "Investigation of a New Analytical Method 
for Numerical Derivative Evaluation" , Communications , ACM . 

Vol. 7, No. 8, August 1964: 465-471. 

7 

Bellman, R. E. , H. Kagiwada, R. E. Kalaba; "Wengert's 
Numerical Method for Partial Derivatives, Orbit Determination 
and Quasilinearization' 1 , Communications ,ACM . Vol. 8, No. 4, 
April 1965: 231-232. 
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Slagle and several others who have written on the subject 

have used list processing to accomplish the taking of the 

derivative. Of course, this process cannot be used by any 

computer which does not have the list processing capability. 

However, for additional comment on the disadvantages of this 

9 

process, see Smith. The paper by Peter J. Smith was received 
too late for a true evaluation by the authors. However, he 
proposed differentiating in symbolic form without the use of list 
processing, or the requiring of the programmer to write subroutines 
as a part of the program. There is, however, no place in Smith's 
paper any mention of getting a numerical answer to the problem 
as well as the symbolic representation of the derivative. 

A means is needed whereby the symbolic representation of 
the derivative is available, as well as the numerical value for 
that derivative. 

9 Smith, P. J. , Symbolic Derivatives without List Processing , 
Subroutines, or Recursion . Ballistic Research Laboratories 
Memorandum Report No. 1630, February 1965. 

9 Ibid. 
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III. METHOD 



1. Definition of an operator for differentiation. 

An operator usually must perform two functions: identify its 
operands and execute its designed operation upon those operands. 
In addition , a derivative operator must identify the variable (s) 
of differentiation. To facilitate the performance of those functions, 
the authors propose the adaptation of the dual nature accorded 
the "Function" within the Fortran language. 

For use in the Fortran language, DX is designated as an 
operator for differentiation. The scope of the DX operator, i.e. , 
its variables of differentiation and its expression to be 
differentiated, are assigned by enclosure in parentheses in 
accordance with the following format: DX; the left parenthesis; 
the list of variables of differentiation, each separated by a 
comma , and the list terminated by a double period; the 
expression to be differentiated; the right parenthesis. For 
example, the algebraic equation, 

>2 2 2 \ 2 
A = X O (X Y + O (XY SIN Z)) , 

^ X ^Y Z. 

would be expressed in Fortran 63 as follows: 

A = X * DX(X,Y. .X**2 * Y**2 + DX(2. .X * Y * SIN(Z)**2)) 
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2. Translation of the Derivative Dual-Operator and its 
argument into reverse Polish notation. 

The stack compilation technique described by Wegner^® is 
utilized in the transformation process. 

In order to determine its "scope" in a reverse Polish string, 
the DX operator must assume the dual nature afforded the 
Fortran "Function". Therefore, the DX is assigned a suffix 
operator; namely, a double comma (the obvious "prime" not being 
available on a keyboard) . When DX is encountered during 
translation from Fortran into reverse Polish, control passes to the 
DX closed subroutine (Figure 4 Page 23) which performs the 
following functions. The "DX" is released immediately into the 
Polish string, and its suffix operator is placed into the operator 
shunt with a priority assigned sufficiently high to insure its 
release immediately upon the encounter of the first operator 
following the expression being differentiated. The argument's 
left parenthesis is then placed into the shunt, the variables of 
differentiation extracted and placed into the Polish string, the 

^Wegner, P. , Introduction to System Programming, 

Academic Press, 1964: 100-121. 
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double period placed into the Polish string, and control then 
returned to the superior routine for normal processing of the 
remainder of the expression. 

3. Execution of the Derivative Dual-Operator. 

Upon encountering the DX dual-operator during the 
translation of the reverse Polish notation into a machine 
symbolic language, control passes to the DX closed subroutine. 
(Figure 5) 

First, the variables of differentiation are extracted, indexed, 
and stored. The double period signifies the beginning of the 
expression to be differentiated. The differentiation process is 
then executed with respect to the variables in the order listed by 
the programmer. 

Differentiation is executed upon operands, whether single 
symbols or expressions, in the order of presentation of their 
algebraic operators, in the normal left to right scan. A simple 
algorithm (Page 27 ) is employed to identify the operands of each 
algebraic operator encountered. The operands are identified with 
respect to position and complexity, and their derivatives are 
identified as zero or otherwise. The differentiation process is 
then executed in accordance with the applicable rule (Tage 28 ) . 
The partial result thus obtained is stored in an array, which 
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serves as a base upon which to build the derivative of the 
following algebraic operator and its pair of operands. In most 
cases, this partial result becomes the first part of the derivative 
of the following operation; thus symbol manipulation is 
minimized. In the regaining few cases only part of the partial 
result requires shifting. Further, zeroes are identified 
immediately, eliminated, and the process scan proceeds on to the 
next algebraic operator. 

Upon completion of execution of partial differentiation, the 
symbolic result is patched into the reverse Polish string between 
the DX and its suffix. At this point, the expression differentiated 
and its derivative can be printed in reverse Polish notation or 
transformed into normal form prior to print-out. Though not 
provided in the attached model program, a code word could 
easily be inserted into the DX format, following the variables 
of differentiation, where it could easily be identified and used 
to command a print-out of the symbolic derivative only when req- 
uired by the programmer for analysis. 

If a DX operator is encountered during differentiation, the 
partially processed results are stored, the new DX operator is 
executed, the stored partial results retrieved, and the process 
continued from the point of interruption. 
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IV. TEST RESULTS 



Sample runs of the program were made on the CDC 1604 
computer at the U. S. Naval Postgraduate School. Thirty test 
equations were used, the last of which being the equation 
presented 'by Hanson. ^ 

The time required to run the entire program, including the 
printing out of the original input equation in Fortran, the 
translation of the Fortran equation to reverse Polish notation, 
the derivatives of the required portions of the equation in reverse 
Polish notation, and the printing out of the macros for the 
evaluation of the equation was five minutes, fifty-three seconds. 
The time required for the compilation of the program was three 
minutes, five seconds. 

Additional runs of the program were made to determine the 
time for the internal execution of the program, eliminating all 
print-outs. The time for this run was four minutes. The time 
required to execute the program giving all print-outs with the 
exception of the macros was four minutes, twenty-eight seconds. 

The sample programming runs that were made showed that 
thirty equations, some of which required the derivative of a 

derivative, required two minutes, forty-eight seconds. 

^Hanson, J. W. , et al. , op. cit . , 349-355. 
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APPENDIX 



LIST OF DIFFERENTIALS PROVIDED IN MODEL PROGRAM 



d (a * u) 


= a * du 


d (u + v) 


=? du + dv 


d (u * v) 


= u * dv + v * du 


d (u / v) 


= (v * du - u * dv) / 


d (u n ) 


= n * u n "* * du 


d (u V ) 


= v * u v ~* * du + u v * ln(u) * dv 


d (a u ) 


= a u * In (a) * du 


d (u u ) 


=u u * (1 + ln(u)) * du 


d exp(u) 


= exp(u) * du 


d ln(u) 


= du/u 


d sin(u) 


= cos(u) * du 


d cos(U) 


= =sin(u) * du 


d tan(u) 


= sec^ (u) * du 


d sqrt(u). 


= . 5*du/ sqrt(u) 



Note 1. Additional functions can be easily added to routine 



Figure 1 
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TRANSFORMATION OF FORTRAN 63 ALGEBRAIC EQUATION 
INTO REVERSE POLISH NOTATION 







g 

\V 



ENTER WITH ALGEBRAIC EQUATION 
STORED IN ALPHA, 

ONE CHARACTER PER WORD, 

LEFT JUSTIFIED. 



Nk. 



y-pc 

IS ALPHA (I) A BLANK SPACE ? 
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Figure 4 
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Figure 4 (Cont'd) 
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ADVANCE POLISH .POSITION CTR. 

ENCODE CHARACTR(J) , J=1 .K 

INTO POLISH (L) . FORMAT (8A1) 




POLISH (L) IS A SYMBOL. 
ADVANCE PARITY CTR. 
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IS PARITY CTR EQUAL TO 1 ? 
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| ARE THERE ANY MORE CHARACTERS 
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IN ALPHA ? 
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note 1 . FOR SIMPLICITY, SUBSCRIPTED VARIABLES ARE NOT CONSIDERED 
HEREIN. THE NECESSARY 'ROUTINE SHOULD BE INSERTED INTO 
PROGRAM AT THIS POINT,. GIVING CONSIDERATION TO PARITY 
COUNTERS AND TESTS.. 



Figure 4 (Cont'd) 
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NOTE r. A UNARY u -" IS TREATED AS ( 0 - OPERAND ). 



Figure 4 (Cont'd) 
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Figure 4 (Coni' d) 
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OR A "/" 

SET PRIORITY EQUAL TO 5 . 
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CURRENT OPERATOR IS AN “(«» 
SET PRIORITY EQUAL TO 2. 
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CURRENT OPERATOR IS A "$'■ 
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REDUCE PARITY CTR 




Figure 4 (Cont’d) 
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NOTE 1 



POLISH (L) IS EQUAL TO THE 
DERIVATIVE DUAL -OPERATOR. DX. 



\i/ 
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FOR SIMPLICITY, THIS ROUTINE RESTRICTS VARIABLES OF 
DIFFERENTIATION TO A SINGLE CHARACTER SYMBOL. IF 
DESIRED. THE ROUTINE PREVIOUSLY' DESCRIBED FOR 
ASSEMBLY OF A MULTIPLE CHARACTER SYMBOL SHOULD BE 
INSERTED AT JUNCTION 882. 
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DERIVATIVE ROUTINE 
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Figure 5 (Cont'd) 
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TYPE INTEGER D, E, V, POL, RHO, RHOP, SING, SHU, VARS, 

BEGIND, BEGINE, ENDD , ENDE, ENTRANCE, EX I T , T ERM I NUS 
DUALOP, OP, FUNCTION, 

ZERO, ONE, TWO, DIV* PLUS, POWER, FUNC, FIXONE, 
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ENTRY TO DERIVATIVE ROUTINE. 

(ENTRANCE) AND (TERMINUS) MUST BE SET TO CORRECT VALUE PRIOR TO ENTRY 
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Figure 6 (Cont'd) 
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Figure 6 (Cont'd) 
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